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MAGNIFYING IMAGE PICKUP UNIT FOR AN ENDOSCOPE, AN 
ENDOSCOPE FOR IN VIVO CELLULAR OBSERVATION THAT 
USES IT, AND ENDOSCOPIC, IN VIVO CELLULAR OBSERVATION 

METHODS 

5 This application claims the benefit of foreign priority from Japanese Patent Application 

No. 2003-094028, filed March 31, 2003, the contents of which are hereby incorporated by 
reference. 

BACKGROUND OF THE INVENTION 

Conventional endoscopes have a large field of view that is in the range of about 90° to 

10 140° so that tissues inside a body can be observed without overlooking lesions. They also 

change the distance to the object in order to obtain either magnified or reduced-sized images of 
an object to be observed, and thus have a large depth of field for a fixed focus point so that 
objects at distances between 3 mm and 50 mm can be observed without re focusing. 

Conventional endoscopes also have an image scale factor with an absolute value of about 

15 30 to 50 when the image is displayed on a monitor having a 14-inch screen, which is sufficient to 
observe diseased tissues. Zoom optical systems are used in order to obtain further magnified 
images, with the absolute value of the image scale factor being approximately 70 when displayed 
on a monitor having a 14-inch screen. The zoom optical system typically has a built-in, zoom 
lens driving mechanism. As a result, the endoscope has an insert tip with an outer diameter that 

20 is larger than 1 0 nun and requires complex operations. Such endoscopes have limited 
applications. 

The manner in which living tissues are observed using a conventional endoscope will 
now be described with reference to Fig. 1 . Living tissues to be observed by a conventional 
endoscope often include a mucous membrane 1, transparent epithelial cells 2 and underlying 
25 parenchymal tissues 3 in which blood vessels run. Light illumination emitted at the endoscope 

tip part 4 must first pass through the mucous membrane and the transparent epithelial cells before 
reaching the parenchymal tissues. The illumination light which reaches the parenchymal tissues 

1 



Attorney Docket No. 20-1 37 

3 is scattered by the parenchymal tissues 3. Of the light that is scattered by the parenchymal 
tissues, most re-enters the epithelial cells. The illumination light is also scattered by cell walls 
5 and cell nuclei 6 when it is transmitted through the transparent epithelial cells. The light rays 
Bl , B2 that are scattered by the cell nuclei of the epithelial cells are weak and thus the light rays 
5 that are scattered by the parenchymal tissues dominate. Consequently, in a conventional 
endoscope, only the parenchymal tissues are observed through an objective optical system. 

When it becomes difficult to provide a diagnosis of an abnormality by observing images 
of a tissue, such as when a lesion is very small, a suspicious-looking tissue may be excised 
during the course of an endoscopic examination. The cells of the excised tissue are then 

10 examined under a microscope. Whereas an endoscope generally uses incident illumination from 
an illumination optical system that is positioned around an objective optical system, a 
microscope instead generally uses an objective optical system and an illumination optical system 
that are positioned on opposite sides of a sample. The sample is normally pre-processed in order 
to make it more suitable for observation, such as by removing the parenchymal tissues by slicing 

1 5 the sample thin in order to reduce scattering and/or by staining the sample in order provide better 
contrast. 

The manner in which a sample is observed using a microscope will now be described 
with reference to Fig. 2. A prepared sample is fixed onto a cover glass 7 and illuminated from 
below with light from an illumination system 8. Illumination light rays Al\ A2' are diffracted by 

20 the cell walls and cell nuclei as they transmit through the sample 9. The diffracted light rays BT, 
B2' interfere with one another both constructively and destructively, producing interference 
fringes that provide visible contrast. Thus, one can observe the sample by using an objective 
optical system 10 placed above the sample. 

Laser-scanning-type confocal endoscopes which have a resolution sufficient for cellular 

25 observation have been proposed that may be inserted within a living body. These typically use a 
confocal optical system having a pinhole for passing an Airy disk light pattern at a position that 
is conjugate to the image plane, and the confocal optical system thus acquires diffraction-limited 
information for each point of an object in the field of view. A laser beam directed from a light 
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emitting optical system scans the object, and information obtained from the reflected light from 
the object for each point is combined so as to produce an image representing either a 
two-dimensional or a three-dimensional object. High resolution can thus be realized not only 
within the image plane, but also in the depth direction. 
5 It takes from several days to several weeks to identify abnormal tissue using conventional 

procedures wherein living tissues are excised and examined in vitro. Moreover, a cellular sample 
that is isolated and fixed for observation is only a tiny part of a removed tissue. Thus, although 
a cellular sample provides information on cellular structures, it is incapable of providing 
important functional information, such as information concerning fluid circulation within cells. 

1 0 This is because the circumstances between in vitro and in vivo examination are completely 

different. Thus, there is a need for magnifying endoscopes that will provide real-time, in vivo 
observation of intact living cells. 

In order to form cellular images of a lesion within a living body, a small-sized image 
pickup unit is necessary that is provided with an objective optical system with an image scale 

1 5 factor having an absolute value that is nearly as high as that of a microscope and which provides 
high resolution. The objective optical system used in a conventional endoscope does not meet 
these requirements. As mentioned previously, in a conventional endoscope as shown in Fig. 1, 
the illumination light is diffracted by the cell walls and cell nuclei as it transmits through the 
epithelial cells. The diffracted light rays Bl, B2 are weak and the light rays Al, A2 that are 

20 scattered by the parenchymal tissues are dominant. Consequently, using a convention endoscope, 
only data from the parenchymal tissues is imaged by the objective optical system. 

Although a conventional objective optical system as used in microscopes is satisfactory as 
far as providing sufficient imaging performance, such an objective optical system is too large for 
easy insertion into a living body. Laser-scanning-type confocal endoscopes have a problem in 

25 that their scanning speeds are still too slow for real-time, in vivo observations. Thus, as 
described above, an image pickup unit that meets the requirements for in vivo cellular 
observation has not yet been realized. 
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BRIEF SUMMARY OF THE INVENTION 

The present invention relates to a magnifying image pickup unit suitable for in vivo 
cellular observation, an endoscope for in vivo cellular observation, and an in vivo cellular 
5 observation method. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully understood from the detailed description 
given below and the accompanying drawings, which are given by way of illustration only and 
thus are not limitative of the present invention, wherein: 
10 Fig. 1 is an illustration to explain a principle of living tissue observation using a prior art 

endoscope; 

Fig. 2 is an illustration to explain a principle of excised sample observation using a 
microscope; 

Fig. 3 shows a configuration of a magnifying image pickup unit according to the present 
1 5 invention, along with other components for displaying endoscopic images; 

Fig. 4 shows the spectral wavelength distribution of an image detected by an image 
pickup unit according to the present invention; 

Fig. 5 shows a magnified image of cells that have been stained for observation according 
to an embodiment of the present invention; 
20 Fig. 6 shows the appearance of cells in the background that overlap cells of interest in the 

foreground; 

Fig. 7 shows the spectral transmittance of a wavelength selection filter used in an 
embodiment of the present invention; 

Fig. 8 shows an image in which information from regions other than regions at a desired 
25 depth is eliminated; 

Fig. 9 shows the spectral transmittance of another wavelength selection filter used in an 
embodiment of the present invention; 
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Figs. lOfa) and 10(b) are a side cross section and an end view, respectively, of an insert 
tip part of an endoscope imaging system that uses specific wavelengths for observation; 

Figs. 1 1(a) and 1 1(b) are a cross-sectional view and an end view, respectively, of the 
magnifying image pickup unit of Embodiment 1 ; 

Figs. 12(a) and 12(b) are a cross-sectional view and an end view, respectively, of the 
magnifying image pickup unit of Embodiment 2; 

Fig. 13 illustrates an illumination method suitable for in vivo cellular observation; 

Fig. 14 is a flow chart of the steps for in vivo cellular observation according to the present 
invention; and 

Fig. 1 5 shows an image pickup unit that simultaneously displays both conventional 
endoscope images and fluorescent images for observation of cell nuclei. 

DETAILED DESCRIPTION 

A magnifying image pickup unit according to the present invention that is applied to an 
endoscope for use in in vivo cellular observation will now be described. 

First, a conventional endoscope having a wide-angle field of view is used so as to provide 
a thorough examination of tissues in an area of the body without overlooking any area that may 
contain diseased tissue. Because it is difficult to diagnose a region of tissue using images 
observed with a conventional endoscope, an endoscope to which the magnifying image pickup 
unit of the present invention is applied (hereinafter termed a magnifying endoscope) is used to 
cellularly examine a region of tissue. 

For magnified cellular observation, coloring agents generally will have been previously 
delivered to the area, if necessary. Within a certain time period after the coloring agent is 
delivered, the difference in the time required for the cell nuclei, the cell walls, and the other cell 
components to excrete the coloring agent creates contrast in the object. Then, a magnifying 
endoscope is guided to the region and contact is made with the object at the tip of the magnifying 
endoscope while observations using a conventional endoscope are continued. Preferably, a tissue 
image from a conventional endoscope and a cellular image from a magnifying endoscope are 
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displayed simultaneously on a TV monitor. In this way, the magnifying endoscope can be guided 
precisely to a very small, targeted region within an extensive observation field of view in order to 
magnify and observe cell nuclei and cell walls. 

Before providing a detailed explanation of a magnifying image pickup unit according to 
5 the present invention, the requirements for an image pickup unit that may be used in a 

magnifying endoscope will be discussed. First, the scale factor required for visualizing fine 
cellular structures will be discussed. The overall observation scale factor bm of an image 
observed on a display monitor is given by the following equation: 

bm = | po |- bd ... Equation (A) 

1 0 where 

(io is the image scale factor of the objective optical system, namely, the height of the 
image as formed on the image pickup element divided by the actual height of the object, and 

bd is the display scale factor, defined as the monitor display screen element size divided 
by the image pickup element size. 
1 5 Conventional endoscopes realize an overall observation scale factor of about 30 to 50 

when the images are viewed on a 14-inch display monitor. Zoom optical systems having a 
magnifying function realize an image scale factor with an absolute value of approximately 70. 
However, an overall observation scale factor in the range of approximately 200 to 2000 is 
necessary for cellular observation when viewed on a 14-inch monitor. Therefore, it is desired 
20 that the objective optical system satisfies the following conditions: 

1 <|po| < 10 ... Condition (1) 

0.9 < | cos wy' / cos wy | < 1 . 1 ... Condition (2) 

where 

po is the image scale factor of the objective optical system, 
25 wy 1 is the incident angle at which a chief ray corresponding to the largest field angle 

enters the image pickup surface, and 
wy is the half-field angle. 

When the lower limit of Condition (2) is not satisfied, the incident angles of rays onto the 
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image pickup element will be too large, failing to maintain uniform image qualities (for example, 
color reproducibility and brightness) within the field of view. When the upper limit of Condition 
(2) is not satisfied, the field angle will be too large, failing to ensure a required scale factor. 

Image resolution will now be discussed. Diseased tissues can be identified with an image 
resolution in the range of millimeters and sub-millimeters. However, cellular observations 
require an image resolution in the range of microns and sub-microns. In order to form detailed 
images of an object that is both transparent and provides only a small difference in refractive 
indexes, the interference of diffracted light rays from the object may be used so as to provide 
images having enhanced contrast. The objective optical system needs to have a larger numerical 
aperture NA on the object side so as to collect higher orders of diffracted light rays and, 
preferably, satisfies the following Condition (3): 

0.1 s NA < 0.8 ... Condition (3) 

In the case where the cell walls are observed, it is preferable to satisfy the following 
Condition (3'): 

0.3 ^ NA ^ 0.8 ... Condition (3 f ) 

In addition, in order to obtain both high contrast and high resolution imaging, the 
objective optical system should have a resolution higher than that determined by the pitch of the 
image pickup element, without exceeding the resolution determined by the diffraction limit. The 
objective optical system preferably satisfies the following Condition (4): 

0.1 < | p • NA 2 / (0.61 • X • po) | < 0.8 ... Condition (4) 

where 

p is the pixel size of the image pickup element, 

NA is the numerical aperture of the objective optical system on the object side; 

X is the e-line wavelength (i.e., X = 0.546 ^im), and 

po is the image scale factor of the objective optical system. 

When the lower limit of Condition (4) is not satisfied, sufficient contrast will not be 
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obtained. When the upper limit of Condition (4) is not satisfied, aberrations become difficult to 
correct, resulting in the failure to obtain fine images. 

Miniaturization (i.e., down-sizing) of the magnifying endoscope will now be discussed. 
It is desirable that the magnifying endoscope have an outer diameter <P of less than 4 mm in order 
that it may be guided to an observation object through a treatment tool insert channel of a 
conventional endoscope. Accordingly, it is desirable that the objective optical system be 
miniaturized so as to have an outer diameter O of less than 2 mm. 

A desired, small-sized, objective optical system having an image scale factor with a large 
absolute value and a high resolution comprises, in order from the object side: a lens unit having 
positive refractive power and an aperture stop, wherein the following Condition (5) is satisfied: 

0.2 < <I>1 / (d>2 • fl) < 2 ... Condition (5) 

where 

<I>1 is the diameter ofthe aperture stop, 

<I>2 is the largest outer diameter of the objective optical system, and 
fl is the focal length ofthe lens unit having a positive refractive power. 

Condition (5) prevents the objective optical system from having a larger diameter in 
association with a larger numerical aperture NA, thus facilitating miniaturization. When the 
lower limit of Condition (5) is not satisfied, the objective optical system will have a larger total 
length and a larger maximum diameter, hampering miniaturization. When the upper limit of 
Condition (5) is not satisfied, aberrations become difficult to correct. 

In order to obtain a flat image surface, it is desirable that the objective optical system be 
formed of, in order from the object side, a front lens unit having positive refractive power, an 
aperture stop, and a rear lens unit having positive refractive power. In such a case, the following 
Condition (6) is preferably satisfied in order to achieve both miniaturization and an image scale 
factor having a large absolute value: 

2 < f2/fl < 10 ... Condition (6) 

where 
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fl is the focal length of the front lens unit, and 
f2 is the focal length of the rear lens unit. 

When the lower limit of Condition (6) is not satisfied, a required image scale factor 
5 having a large absolute value will not be maintained. When the upper limit of Condition (6) is 
not satisfied, a larger overall length and a larger maximum diameter of the objective optical 
system will hamper miniaturization. 

Various embodiments of a magnifying image pickup unit of the present invention will 
now be described. 

K) Embodiment 1 

The structure of Embodiment 1 of the magnifying image pickup unit will now be 
discussed with reference to Figs. 1 1(a) and 1 1(b), which show a side cross section and an end 
view, respectively, of the magnifying image pickup unit according to this embodiment. 

The objective unit comprises an objective lens unit 101 having a uniform diameter in an 
15 objective frame 102. The objective lens unit 101 consists of, in order from the object side: a first 
lens group Gl having positive refractive power, an aperture stop 103, and a second lens group G2 
having positive refractive power. An image pickup element 105 is affixed to an image pickup 
frame 106 via a cover glass 104, thereby forming an image sensor unit. 

The image pickup unit is focused by changing the distance 107 between the objective lens 
20 unit and the image sensor unit. An insert section for a magnifying endoscope is constructed of a 
hard tip member 108 and an outer sheath member 1 10. The image pickup unit is affixed to the 
insert section via an intermediate member 109. 

Fig. 1 1(b) is an end view looking in the direction indicated by the arrow A in Fig. 1 1(a). 
The intermediate member 109 has cutouts (indicated by cross-hatching) at its periphery through 
25 which an illumination fiber 1 1 1 may be inserted and affixed thereto. After the intermediate 

member 109 and illumination fiber are affixed to the hard tip member 108, the image pickup unit 
is inserted and affixed to the intermediate member 109. 
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Referring to Fig. 1 1 (a), when adjustment is required, for example, in the absolute value of 
the image scale factor, the gaps 1 12a and 1 12b that are provided before and after the aperture 
stop 103 can be adjusted to provide a larger or smaller space, if necessary. To do so, gap 
adjustment rings that are made of ultra-thin plates may be used for gap adjustment. A gap 
adjustment part is designed to hold a stack of such ultra-thin plates. A different number of 
ultra-thin plates may be used according to the varied gap sizes needed as a result of an assembly 
process in which parts having a variety of dimensional errors are used. 

Table 1 below lists the surface number #, in order from the object side, the radius of 
curvature R (in mm) of each surface, the on-axis surface spacing D (in mm), as well as the 
refractive index Nd and the Abbe number nd (both at the d-line) of each optical element of 
Embodiment I . Also listed is the outer lens diameter LD of each lens element of Embodiment 1 . 
In the bottom portion of the Table arc listed the distance to the object and the image height, in 
mm. 

TABLE 1 



n 


R 


D 


Nd 




LD 


i 


CO 


0.46 


1.5183 


64.14 


1 


2 


0.84 


0.17 








3 


CO 


0.4 


1.7323 


54.68 


1 


4 


-0.817 


0.05 








5 


1.353 


0.65 


1.7323 


54.68 


1 


6 


-0.703 


0.25 


1.7044 


30.131 




7 


-3.804 


0.09 








8 


~ (slop) 


0.03 








9 


CXJ 


0.4 


1.5156 


75.00 


1 


10 




0.2 








1 1 


1.566 


0.4 


1.67 


48.32 


1 


12 


-1.566 


0.2 








13 


-0.729 


0.3 


1.5198 


52.43 


1 


14 


Co 


0.56 








15 


oo 


0.4 


1.5183 


64.14 




16 


CO 


0.01 


1.5119 


63.00 




17 


CO 


0.4 


1.6138 


50.20 




18 


CO 


0.01 


1 .5220 


63.00 




19 


oo 


0 








Distance to Ihc object = 0 


Image height 


= 0.500 
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Embodiment 2 

Fig. 1 2(a) is a side cross section of the magnifying image pickup unit of Embodiment 2, 
and Fig. 1 2(b) shows an end view looking in the direction of the arrow A shown in Fig. 12(a). 

Table 2 below lists the surface number #, in order from the object side, the radius of 
5 curvature R (in mm) of each surface, the on-axis surface spacing D (in mm), as well as the 
refractive index Nd, and the Abbe number ud (both at the d-line) of each optical element for 
Embodiment 2. Also listed is the outer lens diameter LD of each lens element of Embodiment 2. 
In the bottom portion of the Table are listed the distance to the object and the image height, in 
mm. 

I<> TABLE 2 



25 



30 



// 


R 


D 


Nd 


ud 


LD 


1 


CXJ 


0.88 


1.8882 


40.76 


1.2 


2 


-0.703 


0.05 








3 


oo 


0.4 


1.5183 


64.14 


1.2 


4 


-1.485 


0.05 








5 


2.085 


0.76 


1.8081 


46.57 


1.2 


6 


-0.703 


0.25 


1.8126 


25.42 


1.2 


7 


oo 


0.05 








8 


oo (Stop) 


0.03 








9 


oo 


0.4 


1.5156 


75.00 


1.2 


10 


oo 


0.43 








11 


1.131 


0.5 


1.8395 


42.72 


1.2 


12 


-3.127 


0.2 








13 


-1.061 


0.3 


1.8126 


25.42 


1.2 


14 


OO 


0.2 








15 


-0.592 


0.3 


1.8081 


46.57 


1.2 


10 


2.132 


0.77 


1.8126 


25.42 


1.2 


17 


- 1 .262 


0.77 








18 


oo 


0.4 


1.5183 


64.14 




19 


oo 


0.01 


1.5119 


63.00 




20 


oo 


0.4 


1.6138 


50.20 




21 

22 


oo 

CO 


0.01 
0 


1.5220 


63.00 





35 Distance to the object = 0 Image height = 0.500 
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Table 3 below lists the values of the variables of interest for Embodiments 1 and 2. 



TABLE 3 



10 



item 


legend 


unit 


Embodiment 1 


Embodime 


image scale factor 


Po 




-2.678847 


-6.63 


focal length of front lens group 


fl 


[mm] 


0.765 


0.591 


focal length of rear lens group 


n 


[mm] 


3.476 


4.557 


focal length 


f 


[mm] 


0.657 


0.797 


half of field angle 


wy 


[deg] 


6.141 


3.95 


exit angle of chief ray 


wy' 


[deg] 


13.965 


6.02 


numerical aperture on the object side 


NA 




0.2184 


0.55 


stop diameter 


<I>1 


[mm] 


0.36 


0.66 


largest lens diameter 


<I>2 


[mm] 


1 


1.2 


pitch 


P 




4 


4 


reference wavelength 


X 




0.546 


0.546 



15 



20 



25 



30 



fable 4 below lists the Conditions (1 ) - (6) and the values corresponding thereto for 
Embodiments I and 2. 

TABLE 4 



Condition No. 
1 

2 
3 
4 

5 
6 



Condition 



Embodiment 1 



K|po| £ 10 

0.9 <, | cos wy' / cos wy | <, 1.1 
0.1 <; NA s 0.8 

0.1 < | p-NA 2 /(0.61 - l - Po) | s0.8 
0.2 < <|)| /(<I>2 • fl) < 2 
2 < 12 / fl < 10 



2.680 
0.976 
0.220 
0.215 
0.471 
4.544 



Embodiment 2 

6.630 
0.997 
0.550 
0.544 
0.931 
7.711 



A video observation system suitable for in vivo cellular observation will now be 
described. As mentioned above, living tissues of interest often include parenchymal tissues with 
transparent epithelial cells overlying the parenchymal tissues. The following techniques are used 
in order to create sufficient contrast between the cell nuclei and other cell portions so as to enable 
observation of the epithelial cells within a targeted observation region with no interference from 
the underlying parenchymal tissues. For example, a video observation system suitable for 
distinctly observing a layer of cells that have been stained blue for improved contrast has the 
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following configuration. 

Fig. 3 shows a configuration for the video observation system that uses the magnifying 
image pickup unit of the present invention. The illumination light supplied by a light source 
device 1 1 illuminates an object 12 via a magnifying image pickup unit 13. The light source 
5 device 1 1 is provided with a wavelength selection filter 14, which is positioned in the 

illumination light path, as required, to produce illumination light having a wavelength profile 
suitable for cellular observation. When illumination light having a visible wavelength range is 
used to illuminate living tissue, the shorter wavelengths that correspond to blue reach only the 
surface ofthe living tissue. These wavelengths are useful to obtain information specific to the 

1 0 epithelial cells of the living tissue. Light having wavelengths around 500 nm (corresponding to 
the color green) reaches only slightly below the surface of living tissue. On the other hand, light 
wavelengths corresponding to the color red reach relatively deep inside living tissue. 

An image is formed by the objective optical system of the magnifying image pickup unit 
1 3 at the image pickup surface of the image pickup element. The image pickup unit converts the 

1 5 image into electrical signals and sends them to an image processing unit 15. In processing image 
data ofthe visible region, green wavelength components are used to produce the brightness 
information ofthe object. In this way, images are obtained that are similar to those acquired 
through the human eye. The image data that are processed by the image processing unit 15 are 
displayed on a TV monitor 16. 

20 When the cells that have been stained blue are illuminated by white light that equally 

contains blue, green, and red components, the portions that have been stained blue appear blue 
while unstained portions appear white. Fig. 4 shows a wavelength profile of a cellular image 
formed by the magnifying image pickup unit, with the Y-axis (the ordinate) being the light 
intensity in arbitrary units and the X-axis (the abscissa) being the wavelength in nm. Unstained 

25 portions do not absorb specific light wavelengths and thus provide a nearly flat wavelength 

profile, as is shown by the solid lines 1 7. Portions that have been stained blue absorb red light 
and give a wavelength profile with a drop in intensity primarily for the red component, as shown 
by the broken lines 18. 
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In this way, the contrast between the background (the unstained portions, shown by the 
solid lines) and the cell nuclei and walls (the stained portions, shown by the broken lines) appears 
as a difference in light reflection 19 that is due to light absorption that occurs primarily at the 
longer wavelengths (i.e., the red component) for images obtained using the magnifying image 
pickup unit. 

As shown in Fig. 1 , the epithelial cells are vertically layered. When observing the cells in 
a specific layer, the images of layers of cells that are not at the depth of interest in the epithelial 
cells and the cells of the underlying parenchymal tissues overlap in the background, thereby 
reducing the image contrast. Cell walls are only slightly stained by the staining processes as 
compared to cell nuclei. Fig. 6 illustrates the situation where the images of cells that are not of 
inlcrcst overlap in the background, and (he cell walls are barely recognizable. 

In order to eliminate unwanted images (i.e., noise) overlapping in the background, the 
light that transmits information about the parenchymal tissues, and the cell layers that are not at 
the depth of interest can be cut off in the illumination light path or in the objective optical system 
before the light is detected by the image pickup element. In this embodiment of the video 
observation system, a filter for cutting off a specific range of wavelengths is inserted in the 
illumination light path in order to eliminate unnecessary wavelength components from the 
illumination light. In this case, unnecessary components are mainly the longer wavelengths of 
the visible light range, such as red light. However, it is not desirable to eliminate all the red light 
components because this cuts off the wavelength components that serve to provide contrast 
between the portions that have been stained blue and the unstained portions. 

The present invention uses, for the wavelength selection filter 14 of the light source, a 
filter having a spectral transmittance as shown in Fig. 7. Fig. 7 shows the spectral transmittance 
by solid line with the ordinate (i.e, the Y-axis) being the transmittance and the abscissa (i.e., the 
X-axis) being the wavelength in nm. More specifically, among the illumination light that 
includes the blue, green, and red wavelength ranges, the illumination light of the red wavelength 
range is divided into two wavelength bands Rl and R2. Among the wavelength bands Rl and 
R2, the wavelength band Rl that is nearer the green wavelength range is cut off by the filter and 
thus prevented from illuminating the object. The wavelength band Rl may be, for example, the 
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range 600 nm < X < 700 nm, and the wavelength band R2 may be, for example, the range 700 
11,11 < X < 800 nm - Fi 8- 8 shows an image in which information from regions other than regions 
at a desired depth is eliminated. 

Using illumination light with the wavelength band Rl cut off allows limited light to reach 
5 the parenchymal tissues and the cell layers that are not at the depth of interest, but are within the 
depth of field of the objective optical system. Thus, the image resolution in the depth direction is 
improved by preventing overlapping of unwanted images. On the other hand, the light in the 
wavelength band R2 contributes to producing contrast between the cell nuclei that have been 
stained blue verses the cell walls and other cell portions that remain relatively unstained. Thus, a 
1 0 clear image of the cell layer of interest is obtained with the information from unnecessary depths 
being eliminated. The Iransmittance characteristic shown in Fig. 7 can be realized using a 
dichroic filter. 

A contrast medium can be used to enhance only the cell nuclei. In such a case, the 
contrast medium that is absorbed by the cell nuclei has outer electrons that are excited by 

1 5 excitation light and which emit fluorescent light when they return to the ground state. This 

fluorescent light can be observed in order to accurately identify the cell nuclei. In particular, the 
video observation system according to the present invention is useful for a method where a gene 
contrast medium, such as a gene marker (for example GFP) that reacts with light, can be injected 
into the cells and the identification of a specific gene that occurs when healthy cells are 

20 transformed into diseased cells such as cancer may be accomplished. 

In the method above, the gene in a living cell is altered immediately before the onset of 
disease and a gene marker, which takes no action among the normal cells, identifies diseased 
areas and emits weak fluorescence in response to excitation light. Thus, the video observation 
system used for this observation is desirably provided with a hypersensitive camera. 

25 It is preferable that the video observation system for fluorescent image observation of cell 

nuclei be used in combination with a conventional endoscope. Fig. 15 shows an example of such 
a combination. The fluorescent image observation system is formed as a thin endoscope that has 
an elongated portion 41 . A magnifying image pickup unit 42 of the fluorescent image 
observation system is mounted on the distal end of the elongated portion. The reference numeral 
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43 denotes a conventional endoscope that has a channel 44 that extends from the distal end to the 
proximal end (not shown) of the conventional endoscope. The conventional endoscope also has 
an observation window 45 as well as illumination windows 46 and 47 at its distal end. The 
channel is also used for inserting treatment tools. The elongated portion 41 of the fluorescent 
image observation system is inserted into the channel 44 from the proximal end of the 
conventional endoscope 43 and comes out of the channel 44 via the opening in the channel. The 
endoscope observation system is inserted into a body cavity to be observed. The conventional 
endoscope provides images of the elongated portion 41 that protrudes from the channel for 
guiding the magnifying image pickup unit 42 to the targeted observation region. The TV monitor 
16 (shown in Fig. 3) displays images from (he conventional endoscope as well as fluorescent 
images from the image pickup unit simultaneously, thereby providing more precise and accurate 
observations. 

When a contrast medium that primarily absorbs light of wavelengths shorter than 480 nm 
and emits fluorescent light having wavelengths longer than 470 nm is used, a preferred 
wavelength selection filter 14 for the light source has a spectral transmittance as shown in Fig. 9. 
In Fig. 9, the spectral transmittance is shown by the solid lines with the ordinate illustrating the 
transmittance and the abscissa being the wavelength in nm. 

More specifically, the illumination light of the blue wavelength range is divided into two 
wavelength bands Bl and B2 and, among the wavelength bands Bl and B2, the wavelength band 
B 1 that is nearer the green wavelength range is cut off by the filter. For example, the wavelength 
band Bl may lie in the range 450 nm < X < 500 nm and the wavelength band B2 may lie in the 
range 350 nm < X < 450 nm. In such a case, the objective optical system may be provided with a 
filter that transmits light having wavelengths longer than about 470 nm and cuts off light having 
wavelengths shorter than about 470 nm. Thus, fluorescent images can be observed while the 
excitation light is cut off. The light of the wavelength band Bl that includes the excitation and 
fluorescent wavelengths is cut off from the illumination light. This enables clear images using 
weak fluorescence to be observed with no interference from the excitation light. 

The wavelength selection filter 14 for the light source device can be used with a filter that 
reduces the light intensity of either the green or red wavelength range. This prevents unnecessary 
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image noise in the background of fluorescent images of the cell nuclei and allows a conventional 
endoscope to produce conventional observation images of living tissue. 

An illumination method suitable for in vivo cellular observation is described hereafter 
with reference to Fig. 13. The tip of an illumination unit 30 that serves to illuminate an object 
and the tip of an objective optical system 31 that serves to form images on the image pickup 
surface of an image pickup element using light from the object are located at the tip 32 of an 
endoscope. The central axis L of the illumination field of the illumination unit 30 is shifted from 
the central axis F of the field of view of the objective optical system 31 by a distance d. The 
endoscope tip 32 is placed adjacent living tissue in order to observe the living tissue. The 
distance between a targeted region of the living tissue and the endoscope tip is adjusted so that 
the largetecl region among the epithelial cells and parenchymal tissues which form the living 
tissue is "in-focus" (i.e., centrally located within the depth of field of the objective optical 
system). As shown in Fig. 13, the distance between the position of the epithelial cells 34 and 
endoscope tip 32 is XI and the distance between the position of the parenchymal tissues 33 and 
the endoscope tip 32 is X2. 

The conventional endoscope uses the field of view F2 of the objective optical system to 
observe the parenchymal tissues at the distance of X2. The distance d between the central axis L 
of the illumination field and the central axis F of the field of view at the endoscope tip is 
determined in a manner such that the illumination field L2, which is positioned in front of the 
endoscope tip by a distance X2, includes the field of view F2 in order to ensure a uniform 
brightness in the field of view F2. The distance X2 is several millimeters to several tens of 
millimeters. 

On the other hand, the magnifying endoscope uses an objective optical system having a 
field of view Fl in order to observe the epithelial cells at a distance XI. The distance XI is 
within the range of zero to several microns, that is, substantially zero. Therefore, as shown in 
Fig. 13, the illumination field LI a, which is positioned in front of the endoscope tip by the 
distance XI, may fail to include the field of view Fl of the magnifying endoscope even when the 
distance d between the central axes of the illumination field L and the field of view F at the 
endoscope tip is reduced. Consequently, it is understood that the conventional illumination 
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method fails to ensure a uniform brightness in the field of view Fl of the objective optical 
system. The present invention provides an illumination method in which the parenchymal tissues 
that are positioned still farther in front of the endoscope tip than the farthest position of the 
depth of field of the objective optical system are utilized for uniformly illuminating the field of 
view Fl of the objective optical system. 

As shown in Fig. 13, an observation target is at a distance XI from the endoscope tip 32 
and the parenchymal tissues 33 are at a distance of X2 from the endoscope tip. The illumination 
light emitted from the endoscope tip 32 reaches the parenchymal tissues via the illumination field 
LI a. The parenchymal tissues 33 serve as reflecting and scattering surfaces and thus scatter the 
illumination light. It is assumed that the illumination light emitted from the endoscope tip 32 has 
a Gaussian light distribution profile, and the effective light distribution angle of illumination will 
herein he defined as a light distribution angle co that provides a light intensity that is 1/e times the 
light intensity on-uxis, where c is the base of the natural logarithm. 

As shown in Fig. 13, the illumination light emitted from the endoscope tip 32 is 
transmitted through the living tissues at the light distribution angle col' before it reaches the 
parenchymal tissues 33. After being reflected and scattered by the parenchymal tissues, the 
illumination light is emitted at the light distribution angle co2' and thereafter it reaches the 
epithelial cells at the in-focus region 34 and forms the illumination field Lib at a distance XI 
from the endoscope tip that includes the field of view Fl of the objective optical system. 
Consequently, uniform brightness is ensured in the field of view Fl of the objective optical 
system. 

The light distribution angles coT and co2' are light distribution angles within living tissues. 
The following Equations (B) and (C) are used to convert these light distribution angles to the 
equivalent light distribution angles col, co2 in air. 

sin (ol = 1.33 • sin col' ... Equation (B) 

sin co2 = 1 .33 * sin co2' ... Equation (C) 

The parenchymal tissues are outside the depth of field of the objective optical system, 
therefore, the light reflected and scattered by the parenchymal tissues is not imaged and thus 
merely the illumination effect on the epithelial cells is obtained. It is preferred that the distance d 
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at the endoscope tip between the central axes of the illumination field L and the field of view F 
satisfies the following Condition (7): 

1 < log (d / (XI • tan ©)) < 3 ... Condition (7) 

where 

d is the distance between the central axis of the illumination field and the central axis of 
the field of view of the objective optical system, 

XI is the distance between the leading surface of the endoscope (i.e., the endoscope tip) 
and the in-focus point of the objective optical system, and 

0) is the light distribution angle that provides a light intensity that is 1/e times the light 
intensity on-axis, where e is the base of the natural logarithm. 

When the upper limit of Condition (7) is not satisfied, uniform brightness will not be 
ensured in the field of view of the objective optical system. When the lower limit of Condition 
(7) is not satisfied, it will be difficult to locate the tips of the illumination unit and the objective 
optical system at the endoscope tip with the outer diameter of the endoscope tip being maintained 
small. 

In addition, the following Condition (8) is preferably satisfied: 
5 < d / (X2 • tan co) s 30 ... Condition (8) 

where 

d and to are as defined above, and 

X2 is the distance between the leading surface of the endoscope (i.e., the endoscope tip) 
and the reflecting and scattering surfaces, such as the parenchymal tissues. 

When the upper and lower limits of Condition (8) are not satisfied, uniform brightness 
will not be ensured in the field of view of the objective optical system. 

It is also preferred that the following Condition (9) be satisfied: 

0.5 < log(X2/Xl) ... Condition (9) 

where 

X2 and XI are as defined above. 

When Condition (9) is not satisfied, the parenchymal tissues are imaged in the field of 
view, deteriorating the image quality. 
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Table 5 below lists various values of X2, XI, d and co pertaining to Embodiments 1 and 2 
of the present invention. 



TABLE 5 



5 



item 


legend 


unit 


Embodiment 1 


Embodiment 2 


scatterer distance 


X2 


[mm] 


0.1 


0.1 


objective in-focus distance 


XI 


[mm] 


0.015 


0.002 


illumination parallax 


d 


[mm] 


0.8 


1 


illumination distribution angle 


0) 


[deg] 


35 


35 



10 

Table 6 below lists the Conditions (7) - (9) and the value of each for Embodiments 1 and 

2. 

TABLE 6 

Condition No. Condition Embodiment 1 Embodiment 2 

15 7 1 < log (d / (X 1 • tan co)) < 3 1 .88 2.85 

8 5 < d /( X2 • tan o>) < 30 11.4 14.3 

9 0.5 < log(X2/XI) 0.82 1.7 

The method for diagnosing the presence/absence of abnormal cells (i.e., whether cells are 
20 cancerous or not) from magnified cell images will now be described. 

Fig. 5 shows stained cells that are magnified and observed according to Embodiment 1. 
The image pickup unit used in the magnifying endoscope observation system is set for a scale 
factor that allows several tens to several hundreds of nuclei to be observed on a monitor. For 
example, several tens to several hundreds of cell nuclei are displayed on a monitor and the cell 
25 density in the observation field of view can be evaluated based on the distance between cell 
nuclei in order to diagnose the presence/absence of abnormal cells. The cell density can be 
compared with normal samples and statistically analyzed. 

The magnifying endoscope observation system above is specified for a resolution and a 
magnification sufficient for nucleic observation. With the observation scale factor further 
30 increased, the image pickup unit displays several cell nuclei on a monitor and the number of cell 
nuclei in a unit area is translated to the cell size, or the cell nuclei are evaluated for shape, in 
order to diagnose the presence/absence of abnormal cells. For example, cancerous cells present 
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particular characteristics such as increased size and irregular shapes. Thus, the size and shape of 
cell nuclei can be evaluated in order to diagnose cancerous cells. 

Fig. 8 shows cell nuclei and cell walls that are magnified and observed according to 
Embodiment 2 of the present invention. The magnifying endoscope observation system is set for 
5 a scale factor that allows several nuclei to be observed on a monitor. The ratio of the area S' of 
the cell nuclei divided by the area S within the cell walls in the field of view is herein defined as 
the "occupancy" of the nuclei in the cells, and is used to diagnose the presence/absence of 
abnormal cells. For this analysis, the magnifying endoscope observation system is specified so 
as to have a resolution and contrast sufficient for observation of both cell nuclei and cell walls. 

10 Fig. 14 is a flow chart of a series of procedures for the in vivo cellular observation 

described above. As noted in the drawing, there is a pre-trcatmcnt stage, followed by a cell 
visualization stage, followed by a stage of abnormal cell diagnosis. During pre-treatment, the 
following steps arc performed: detect a suspicious region by using a conventional endoscope; 
deliver a coloring agent using a conventional endoscope; selectively stain cell parts due to 

1 5 differences in time for cells to intake or excrete the coloring agent; and guide a magnifying 
endoscope to the suspicious region and contact the tip thereof to the region for observation. 
During cell visualization the following step is performed: emit illumination light having selected 
wavelengths; the illumination light including wavelength band T2, with the wavelength band Tl 
being nearer the green wavelength range than is the wavelength band T2, for visualizing cells due 

20 to differences in absorbency, and wavelength band Tl for cutting off data at depths not targeted. 

During abnormal cell diagnosis, the following steps are performed: display several tens to several 
hundreds of cell nuclei; and, display several cell nuclei and the cell walls. Note that in CELL 
VISUALIZATION of Fig. 14, the second and third boxes are not separate steps; instead, these 
boxes merely indicate the details of the selected wavelengths. 

25 The system described above in which specific wavelength bands are used from a white 

light source provides excellent flexibility where plural wavelength properties are selectively used 
in the illumination light, depending on the observation target and the selected coloring agent. On 
the other hand, where the wavelength property of the illumination light is predetermined, a single 
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color illumination light, for example, can be used to further simplify the configuration. 

An endoscope tip part of an endoscope imaging system specified for observation with 
specific wavelengths of light is illustrated in Figs. 10(a) and 10(b), with Fig. 10(a) being a side 
cross section and Fig. 10(b) being an end view. The image pickup unit according to the present 
invention has a small observation distance and therefore, the light source can be formed of LEDs 
20 that emit a single color at low power. The LEDs 20 can be mounted in the endoscope body. 
Furthermore, when LEDs are installed at the tip of the endoscope, a light transmission optical 
fiber can be eliminated. Because aberration correction is necessary for only a single color when 
an LED light source is used, the fluorescent image observation system 21 can be provided with a 
simplified optical system that includes, for example, a single aspherical lens 23 positioned in 
front of a stop 24, and an image pickup element 25 positioned after the stop 24 at the image 
surface. Alternatively, plural spherical lenses (not shown) can be used in lieu of using a single 
aspherical lens. 

An image pickup element that has been made compact and simplified as described above 
provides more freedom in mounting such an image pickup unit on a medical device such as an 
endoscope. For example, an image pickup unit may be combined with a treatment tool such as a 
catheter or laser probe that uses a flexible, insertable device. Or, an image pickup unit may be 
combined with a non-flexible treatment tool by making the image pickup unit compact and with 
a shape such as a pen or capsule by using wireless transmission of image data. 

The invention being thus described, it will be obvious that the same may be varied in 
many ways. Such variations are not to be regarded as a departure from the spirit and scope of the 
invention. Rather, the scope of the invention shall be defined as set forth in the following claims 
and their legal equivalents. All such modifications as would be obvious to one skilled in the art 
are intended to be included within the scope of the following claims. 
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